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This paper argues that the first step in research 
aimed at identifying what constitcites the^ effectire reading teacher* 
should be the establishment of'cr'iterda which deals wi€h , 
effectiveness. A. conpeptual model i? presented which could toe; used to 
identify ^the effective teacher, ^he focal point 6f th6 model is that 
effective . reading instruction should be' based on measures of " / 
students' outcome and then look ^or process variat-les whic^h jcoul'd* 
explain the^product. This approach is based on the assumptidn that - 
students' end of school year reading achievement Is directly affe^Ved 
by the reading^ instruction which they received during that .school \ 
jear. The model 'is then discussed in ^grteis 'of tfere^ alternative • : 
assessment instruments, determining the appropriate unit- o'f. analff^is^ 
and making decisions about hQw" to best examine these data. (TS) ; 
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Although, the literature on teacher effectiveness and various hy- 
I ■ ■ ■ ■ ? , 

pothesi>zed py^edictors of s.uccess extensive, there is a general con- 
sensus among reviewers of this research that the variables under inv^sti 
gation, considerations for control., and the criteria ysed to identify 
effective teachers make the results questionable.' In ttre opinion ^f 
McNeil and Popham (1973), researchers have not focused on "the best . 
criterion to judge teacher effectiveness (modification in tKe learner), 
but have used more readily available criteria. Saadeh (1970) expressed 
a similar concern and indica^tea that the identification of effective- 
teaching must be based on pupil outcome measures and not just on the 
teaching process../ Further evidence supporting the deficiency of; re- 
/Search on teacher effectiveness is Evidenced by the findings of Rosen- 
shine (1970). He concluded from a review of 35 studies which attempted 
to relate low inference teaching behavi ors to pupil achievement, that. 
the more important variables are being overlooked in studies employing 
systematic observation. . ■ • ^ 

" ■ / 

Effective Teachers of Reading ^ \ j 

A review of the research aimed at effective reading, instruction /in 
relation to student achievement in reading, is infi^tesimal in com- ' 
parison with the plethora of reading research which has Been conducted. 

However, there are some research findings which (do ^relate to the 
various instructional components of an elementary developmental/ V^^ading 
program, and some of these do relate to student ^utcome measures.'/ For 
example, Harris (1969), focuse^ on teacher criticish^in reading instruc- 
tion and found that strong criticism negatively affectV student " 
achievement. Bl^ir (1974), looked-at the effort exerted\)y teachers , 



.2 

of reading in thefr use' of supplementary materials, differentiated instruc- 
lion-, and moni-toring^ of student progress. He found significant differences 
in' pupils)^ reading achievement in favor df the h'igh effort teachers. Harris 
an-d Seiner (1966), discovered that teacherl who\l^e c/mpetei^t with a par- 
ticular reading method and followed its pl-escri pti on h^d higher achieving 
students in reading. 

•v 

Althoiigh these investigations and othfers may, look at process in 
rel'ation to ' product, 'and the results-are bfeginnjng' to further delineate 
characteristics' associated with effective leading instruction, there 
still exists, a tendency to investigate only a small portion of the total 
reafdi'ng program. Th'is myopic view of attemf)ting to identify credible 
variables and then relate these to pup.il acHi'evement is, in all prob.- / 
ability, more a result of methodological incarceration "than a .reflection 
of the capabilities of the investigators. 1 ^ 
Ideatification of Effective Reading Teachers \ 

The first step in research aimed "at identifying what constitutes 
the. effective reading teacher should be the esti^blishment of criteria- 
which deals directly with effectiveness. This t^t would- first require- 
looking at product, pupils' reading achievement, i^hen identifying process 
variables which could account for thi s^ achievement. Figure 1 presents 
a conceptual model which could be used to identify the effective read- 

ing teacher. ' , 

^ * Insert Figure I" ! 



The i'ocal point of this conceptual model is that effective reading 
instruction should be based on measures of students (|)utcome and then 
look for process variables v^hich could explain the product. Lo^gieally, 
students' end of year achievement .would be the produc|t criteria' for " 



determining teacher effe.ctiveness.* This' approa'ch is /bSSed on the ass.ump- 
tion that students' end of. school year reading. achie.verTie.nt is' directly 
affected by the reading ioAruetion which they r-ecei-ved during that 

school year. j '* *. * 

As the model ^ndicates there are at least three ,al ternati ves avail- 
able to the researcher--- norm )cef^renced tests, criterion referenced ' • 
tests and informaj measures - for assessing \pupi Is ' ecd of year reading 
achievement. The decision about which of this-e is the most approp/iate 
would best.be made by the Investi gato-r., HoweVer* the final decision 
should be based on factors which consider the \rel i abi 1 ity and validity of 
.the instrument and how the results could most Effecti vely be used to reach 
some final decisions about pupils'; reading achilevement. 

» Regardless of whi(;h type of instrument is dh.osen, an important ^n- 
sideration f of 'th^ investigator is determining, tie appropriate unit of ' 
analysis'. From both a logical and/e(npi rical point of view, the unit of - 
analysis for determining end of year reading achievement would-be to use 
the mean .reading achievement scores of classes ratlier than the reading 
achievement score o'f' indi vidual students. This confcept is based on the 
idea that the. variance wfthin a group of students having a common exper- 
ience is significantlysmal'ler than the variance of individual students 
within t'he class (Stech, 1965)/. An exception to this procedure would be ' 
one in wh-ich students are instructed on a'^totally individual basis, i.e.,_ 
remedial reading programs employing a diagnostic prescriptive approach, 
in this type of '.program the a^ppropriate unit of analysis would the ^ 
reading achievement of the intii vidual students". 

Followir\p the* selection of the most pippropfiate measureiiTent 



stered in the faU' with 



instrument 'and determining the correct unit of analysis the investigator 
needs .to make a derrsi on, about how to best look at-these data. There 
aje at least three alternatives available for this purpose: (1) predicted 
reading achievement in comparison with "actual ; reading achievement, (2) 
actual end of year reading achievement comparekd to students' grade, level, 

# / 

and (-3) caraparison of pretest results admini 
posttest results taken in the spring.. 

• Of't'hese three alternative's the least desirable procedure would be 
to- compare end of year reading achievement^with the gr^e le.vel of the 
students. In reading" research dealing with teacher effectiveness research- 
ers cannot, bfe certain that the observed differences between the students' 
grade level placement and their reading achievement is due to teacher 
effectiveness. Such observed differences may be an artifact of matura- 
tion, or the observed difference in reading achievement may not differ 
. significantly from what woulcl be expected. ^ ' • 

i^other alternative, which is historically firmly ensconced in 
educational' research, is' a pretest-posttest design. This"' design typi- 
cally includes a control group and an experimental, group, with a treat- 
ment administfcred to the experimental -group. The power of this design 
is well' recognized by educational researchers, howevef; U mos.t likely 
is a premature decision for' research aimed at identifying effective 
teachers Of reading. -This design dictates that apriori decisions must 
be made for identifying and testing credible variables which may or- may 
not account for teacher effectiveness. ToO often, this design results* ^ 
in' methodological incarceration and the variables under investigation 
are not those related to teacher ptrocess and student, product, but are 
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selected on the basis of their accessibility,. The pre-posttest design -is. 
a powerful design; however, for identifying effective reading teacher it 
should be employed to look at , the' observed reading achievement differences 
in relation to what a class would be expected to achieve. • ' . 

Of the three aforementioned -design al t^rnatives the most appropri- 
ate would be the use of expected mean cl ass | reading achievement in re- ' 
lation to actual mean class • reading achievement. This allows the inves- 
tigator to determine teacher effectiveness jn a more objective manner - 
those -classes who significantly achieve abo\jre what would be predicted 
would be associated with effective reading ieachers. 

There are two- stati tistical procedures Iwhich can he used to predict 
at what level a class shou^ld be readi^ng. Onie is the use of a least 
squares prediction J ine (Glass & Stanley, 19^0i) and the othe^ is compu- 
ting the mean monthly e^cted reading gain, i 

„ An example of the use the prediction line would be the use of. 
end of year mean IQ and readtpg achievement sicores, for a large sampling 



of classes ^9t a specific grade level, to geneirate the prediction li^^ 
then plot the individual classes and note wher^ they ar^ in relation - 
to it. Thos-e classes who deviate significants above the prediction^ 
line would be associated -with effective teacher^ of reading. Conversely, 
those classes who deviated significantly below the prediction Tine would 
be associated with Ijess effective teachers of reading. 



Insert Figure 2 



\ similar procedure, but one which eliminates the currently con- 
.troversial aspect of IQ, is to compute the mean month1y"reading growth 
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• for a class' of students entering a specific grade level an^d u?e this pre- 

* f . ,■ «. ■ 

•vious reading growth rate to compute the exptected. end of year reading 

•r ■ . . 

achievement. To compute the expected reading' achievement for a class 
at the end of a grade level the mean monthly reading achievement is 
multiplied times the number of months of formal reading instruction • 
(excluding kindergarten) up to' the point in time where the end of year 
reading achievement will be formally assessed. The class. mean expected 
reading achievement would then be compared with the class mean actual' 
reading achievement. A significant difference noted between expected and 
actual reading achievement would then be used to identi'fy effective and 
less effective teachers! For example, a third grade class is in the 1st 
few days of current schdol year. The class was administered a reading 
achievement test at the end of the 10th month in sepond grade'. Their, 
mean class reading achievement "score was'^.O. Th© mean expected monthly * 
reading achievement is .1. At the end of third grade (30 months) the mean 
expected reading achievement of the' class would be 3.0. At the end of 
third. grade (10th month) the actual 'mean reading achie,yements is 4.1. 
^' ■i^Spmparing the actual class mean reading achievement with the mean p^- 
Scted reading achievement (1/2 standard deviation) this' class exceed- 
■ eadl% pred&ted by 1.1, which is significant, and tliis teacher could be 
\ coHiSf^red an: effective teacher of reading. I 

these statistical procedures requii* the establishment of a 
1 bf^^^ificance 'around the predi cted , reading achievement. , If a 
prediction.'^7%e is used^, the level of significance .could be - one-half 
a standard eritfe of estimate. If average monthly gain is us^d, the level . 
of significan£e'|?tfuld be ± one-Jialf a standard deviation around the.. 
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predi cted ^re adi n g a^ch i e vemen t . 

' One-half a standard error of estirpate or one-haTf^a standard^deviation 
above and below the predicted score is necessary .to "increase the degree 
of confidence in identifying'teacher effectiveness, to account for the 

the chance \\ 

< 



standard error of measurement, and to account for the chance probability , 

< 

score on the criterion instrument. 

; At this p'oint a researcher should be able to identify effective ^ 
'teaihers of reading and less effective teachers of reading, ' K is here 
that research^, depi si ens cc^n now be made,'" Credi>ble hypotheses wh/ich could 
account for; the differences in teacher effectiveness can be formulated 
and tested, longitudinal research which attempts to determinB if teacher 
effectiveness is stable over time' dan be initiated, observap'onal instru-r 
ments can be employed to record teacher bebavior, ancj varioys types "of - 
research designs can be used, to further^ del ineate whH constituted 
effective teaching of reading, ' . . " ! 



conceptual" research model for INDEfjriFYING EFFECTIVE TEACHERS OF READING 



Teaeher effectiveness in relation to 
pupils' reading achievement 



Assessment of pupijs' reading » achievement 
at end of schtol year ; — 



Norm, Referenced Tests i 



Criterion Refer^enced tests 



Informal Measures 
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, E^^)ected reading 
Achie vemer/t vs . Actual 













Prediction line based^ 
on-class" mean IQ and • 
reading a.chieVement 




Average month expec^ 
reading gain vs. acul^l 
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Poor deefsion pupils' 
gain may not be sig- 
nificant in relSKtion' 
to the reading le.vel 
which they should be 
a^h'ieving ' - 



Establish a level 
of significance {-) 
in relation to expected 
reading_ achievement 



Effective. readihg teacher 
^if. actual class mean read- 
ing score exceeds predicted 
at or beyond, the established 
levej of significance 



Less effective-reading 
te,ache'r if actual class . 
mean reading achievement 
is tielow the established 

level of significance 

> ■ ■ 



Ad\7ance credible hypotheses 
to account fOr differences. 
Longitudinal research tcf* 
determine if_effecti veness 

i's constant over_t^ime 

^ 



Select appropriate research 
design and alpha level 



With an experi- 
mentarl/control 
group design 



Premature decision 
research may be* • 
-limited due to 
methodological 
incarceration 
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X Less Effecti ve^Teacher 
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f i gure 2 . iKafti e, of the u^„ pf a Predi cti on- Li ae 
• -4 foilai^tify. Effective and- Less Effective 



t6'«iE:h,^rs of Readi ng . 
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Most recent cla^X rdg. ach. score ^-^^ X Total -wos. of rdg. nns^. V 

Tot al . mos.- of/f^dg ; i ns t . Xpnor to assess.ment) k ^ ~. . . 

mos. up to next formal assessment = E;cp#feted^^iieadftg Achie^^ 

ff gnd of year assessment X" than pre/lictetl en^d of year X = fcffecftve ^ 
^Reading Jeacher, . , . ' ■ " '] ' /' / 



Example: 



^ X (14 + 8r^.l428^X 22 = 3.13 {t error) expected Xr at end 
of 8th monttf of current grade pl'acement. v; 



If actual rdg. X" = 4.1 

T*he difference between actual and expected^:ys sVgnifica 
and this* teacher would be 'deemed. effective/. . 



Figure 3. 





Example of Protedure for Computing 
X Expected Reading Achievement fased 
on Average Monthly Reading Gann. 
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